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FIELD OF THE INVENTION 

The present invention relates generally to 
communications networks and, more particularly, to 
advertising via communications networks. 

RELATED APPLICATIONS 

This application claims the benefit of U.S. 
Provisional Application No. 60/224,152, filed August 10, 
2000 . 

BACKGROUND OF THE INVENTION 

The Internet has gained broad recognition and 
acceptance as a viable medium for communicating and for 
conducting business. The World-Wide Web (Web) is 
comprised of server- host ing computers (Web servers) 
connected to the Internet that have hypertext documents 
(referred to as Web pages) stored therewithin. Web pages 
are accessible by client programs (e.g., Web browsers) 
utilizing the Hypertext Transfer Protocol (HTTP) via a 
Transmission Control Protocol/Internet Protocol (TCP/IP) 
connection between a client-hosting device and a server- 
hosting device. While HTTP and Web pages are the 
prevalent forms for the Web, the Web itself refers to a 
wide range of protocols and Web content formats. 

With the increasing mobility of today's 
society, the demand for mobile computing capabilities has 



also increased. Many workers and professionals are 
downsizing their laptop computers to smaller hand-held 
devices, such as personal digital assistants (PDAs) . In 
addition, many people now utilize wireless devices, such 
5 as cellular telephones, to access the Internet and to 

perform various other computing functions. Wireless 
devices may include, but are not limited to, PDAs, 
cellular telephones, pagers, and communicators. Many 
wireless devices also utilize the Microsoft® Windows® CE 
10 and 3Com Palm® Computing platforms. With the advent and 

development of wireless telecommunications systems and 
technologies, wireless Internet access is increasing 
worldwide . 

As the Web has evolved into a viable commercial 

15 medium, advertising has become an important source of 

revenue for many entities. Web pages served from Web 
sites may utilize advertising to promote various goods 
and services. For many conventional wireless devices, Web 
content is displayed as a sequence of displays (cards) . 

20 To subsidize costs, wireless content publishers may use 

advertisements mixed with content, often as interstitial 
displays within a sequence of content displays. 

Conventionally, advertisements are served from 
an advertisement server, as illustrated in Fig. 1. A 

25 browser executing within a client device 10 requests an 

advertisement from an advertisement server 20, 
represented by A. The advertisement server 20 returns the 
advertisement to the client device for insertion within a 
displayed Web page, represented by B. When a user clicks 

3 0 on the displayed advertisement, a request is sent to the 

advertisement server 20, represented by C. In response, 
the advertisement server 20 returns a redirection 
directive associated with a third party advertiser to the 
browser, represented by D. The browser follows the 

35 redirection to a Web site of the advertiser 25, 
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represented by E, wherein additional details and/or 
information can be obtained, represented by F. 

One of the primary functions of an 
advertisement server is to store (and allow retrieval of) 
information on the effectiveness of a given advertising 
campaign (referred to as "accounting"). The effectiveness 
of advertising via the Internet is conventionally 
measured by monitoring the " click- through" rate 
associated with advertising. A " click- through" event 
occurs when a user interacts with an advertisement 
displayed within a Web page by "clicking" on the 
advertisement (e.g., via a mouse or other input device) . 
Conventionally, an advertisement server is notified when 
an advertisement is served, and when a user clicks on the 
advertisement. These advertisement servers typically 
maintain statistics on how many times advertisements have 
been served, how many times they have been »clicked-on" , 
etc., even if advertisements are served from multiple 
sites in multiple domains. 

"Voice portals", which allow access to the 
Internet via telephone, are becoming increasingly 
popular. Utilizing speaker- independent speech recognition 
and text-to-speech technologies, voice portals can be 
accessed via wireless and wireline telephones and can 
allow users to "verbally" surf the web and make 
transactions {e.g., purchase airline tickets). Voice 
Extensible Markup Language (VXML) allows a user to 
interact with the Internet through voice-recognition 
technology. Instead of a traditional browser that relies 
on a combination of HTML and keyboard and/or mouse, VXML 
relies on a voice browser and/or the telephone. Using 
VXML, a user interacts with a voice browser by listening 
to audio output that is either pre-recorded or computer- 
synthesized and then submitting audio input either by 
voice or by keypad. 

As with the visually browsed Internet, voice 
-3- 



portals are expected to generate revenue by selling 
advertising "space" on their sites. Advertising space for 
a voice portal relates to audio advertisements 
interspersed with content. Thus, when "listening to the 
5 Web", a user might hear advertisements similar to those 

conventionally heard via radio. 

Unfortunately, delivery, management, and 
accounting for audio advertisements may be difficult via 
conventional advertisement server systems. In addition, 
10 audio advertisements may not be capable of interacting 

with conventional Internet advertising. As such, a need 
exists for integrating audio advertisements with 
conventional advertisement server systems and for 
allowing interaction with audio advertisements. 

15 

SUMMARY OF THE INVENTION 

In view of the above, the present invention 
provides systems, methods, and computer program products 
that can facilitate the integration and accounting of 

20 advertising within audio Web content requested by users 

via telephone devices. Upon receiving a request from a 
user for Web content via a telephone device, a Web server 
retrieves an advertisement from an advertisement server, 
inserts the retrieved advertisement within the user 

25 requested Web content (i.e., within a VXML document (s) 

representative of the Web content) , and forwards the user 
requested Web content and advertisement to a text-to- 
speech transcoder for conversion to an audio format. The 
text-to-speech transcoder converts the Web content and 

3 0 advertisement from a text -based format to an audio format 

and serves the Web content and advertisement in the audio 
format (i.e., as an audio stream) to the user client 
device via a telephone link established with the user 
client device. 

3 5 According to embodiments of the present 

invention, if an advertisement is configured to be 



interactive, a text-to- speech transcoder may be 
configured to notify an advertisement server of user 
interaction with the advertisement. For example, user 
interaction with the advertisement (i.e., by pressing a 
key on a keypad during the advertisement and/or by 
speaking one or more recognizable words and/or phrases) 
is recorded by an advertisement server. Moreover, 
information such as, but not limited to, an 
identification of the requesting client device, user, and 
time and date information, may be recorded by an 
advertisement server for use in measuring effectiveness 
of a particular advertising campaign. Information 
associated with providing a user with additional 
information associated with an advertisement may also be 
stored . 

According to embodiments of the present 
invention, a text-to-speech transcoder may be configured 
to retrieve additional information associated with an 
advertisement in response to user interaction therewith 
and deliver the additional information to a user client 
device in an audio format. For example, a text-to-speech 
transcoder may be configured to recognize key words 
spoken by the user during delivery of an advertisement. 
In response to recognizing one or more key words spoken 
by the user, a text-to-speech transcoder may be 
configured to redirect the user client device to 
additional Web content associated with the advertisement 
{e.g., to another Web site). According to embodiments of 
the present invention, additional information may 
retrieved from (or via) an advertisement server and 
delivered to a user client device. 

An advertisement server according to 
embodiments of the present invention may be configured to 
store information associated with serving an 
advertisement to a user, as well as information 
associated with user interaction with an advertisement. 



According to additional embodiments of the present 
invention, an advertisement server may be configured to 
determine if and/or how many times a user listens to an 
advertisement. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram that illustrates how 
advertisements are served from a conventional 
advertisement server. 
10 Fig. 2 is a block diagram that illustrates 

a computer system according to embodiments of the present 
invention that is configured to integrate interactive 
advertising within audio Web content requested by users. 

Fig. 3 is a block diagram that illustrates an 
15 exemplary data processing device upon which embodiments 

of the present invention may be implemented or practiced. 

Figs. 4-5 are flowcharts that illustrate 
operations for integrating interactive advertising within 
audio Web content according to embodiments of the present 
20 invention. 

= DETAILED DESCRIPTION OF THE INVENTION 

The present invention now is described more 
fully hereinafter with reference to the accompanying 

25 drawings, in which preferred embodiments of the invention 

are shown. This invention may, however, be embodied in 
many different forms and should not be construed as 
limited to the embodiments set forth herein; rather, 
these embodiments are provided so that this disclosure 

30 will be thorough and complete, and will fully convey the 

scope of the invention to those skilled in the art. 

As also will be appreciated by one of skill in 
the art, the present invention may be embodied as 
methods, data processing systems, and/or computer program 

35 products. Accordingly, the present invention may take the 

form of an entirely hardware embodiment, an entirely 
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software embodiment running on general purpose hardware 
or an embodiment combining software and hardware aspects. 
Furthermore, the present invention may take the form of a 
computer program product on a computer-usable storage 
medium having computer-usable program code embodied in 
the medium. Any suitable computer readable medium may be 
utilized including hard disks, CD-ROMs, optical storage 
devices, or magnetic storage devices. 

Computer program code for carrying out 
operations of the present invention may be written in an 
object oriented programming language {e.g., JAVA®, 
Smalltalk or C++) and/or may also be written in a 
conventional procedural programming language (e.gr., "C"). 
However, software embodiments of the present invention do 
not depend on implementation with a particular 
programming language. Program code may execute entirely 
on one or more server computer systems . 

The present invention is described below with 
reference to block diagram and flowchart illustrations of 
methods, apparatus (systems) and computer program 
products according to embodiments of the invention. It 
will be understood that each block of the block diagrams 
and/or flowchart illustrations, and combinations of 
blocks, can be implemented by computer program 
instructions. These computer program instructions may be 
provided to a processor of a general purpose computer, 
special purpose computer, or other programmable data 
processing apparatus to produce a machine, such that the 
instructions, which execute via the processor of the 
computer or other programmable data processing apparatus, 
create structures for implementing the functions 
specified in the block diagram and/or flowchart block or 
blocks. Each block, and combinations of blocks, can be 
implemented by servers which perform the specified 
functions or steps, or combinations of special purpose 
hardware and computer instructions. 



These computer program instructions may also be 
stored in a computer- readable memory that can direct a 
computer or other programmable data processing apparatus 
to function in a particular manner, such that the 

5 instructions stored in the computer-readable memory 

produce an article of manufacture including instructions 
which implement the function specified in the block 
diagram and/or flowchart block or blocks. 

The computer program instructions may also be 
10 loaded onto a computer or other programmable data 

processing apparatus to cause a series of operational 
steps to be performed on the computer or other 
programmable apparatus to produce a computer implemented 
process or method such that the instructions which 

15 execute on the computer or other programmable apparatus 

provide steps for implementing the functions specified in 
the block diagram and/or flowchart block or blocks. 

It should be noted that, in some alternative 
embodiments of the present invention, the functions noted 

20 in the blocks may occur out of the order noted in the 

figures. For example, two blocks shown in succession may 
in fact be executed substantially concurrently or the 
blocks may sometimes be executed in the reverse order, 
depending on the functionality involved. Furthermore, in 

25 certain embodiments of the present invention, such as 

object oriented programming embodiments, the sequential 
nature of the flowcharts may be replaced with an object 
model such that operations and/or functions may be 
performed in parallel or sequentially. 

3 0 Referring to Fig. 2, a computer system 4 0 

configured to integrate interactive advertising within 
Web content requested by users via client devices 50 
(e.g., wireline and/or wireless telephone devices), 
according to embodiments of the present invention, is 

35 illustrated. The illustrated computer system 40 includes 

a text-to-speech transcoder 42 that is configured to 
-8- 



convert Web content (including advertisements) from a 
text-based format (e.g., VXML format) to an audio format, 
a Web server 44 that hosts Web content, and an 
advertisement server 46 that provides advertisements for 
5 insertion within Web content delivered in response to 

user requests. The text-to-speech transcoder 42, Web 
server 44, and advertisement server 46 may be implemented 
via a single data processing device or via multiple data 
processing devices. Moreover, the text-to-speech 
10 transcoder 42, Web server 44, and advertisement server 46 

may be implemented via remotely located data processing 
devices . 

Fig. 3 is a block diagram that illustrates an 
exemplary data processing device 60 upon which 

15 embodiments of the present invention may be implemented 

or practiced. A separate data processing device 60 may be 
used to implement the text-to-speech transcoder 42, Web 
server 44, and advertisement server 46. Alternatively, 
two or more of the text-to-speech transcoder 42, Web 

20 server 44, and advertisement server 46 may be implemented 

via a single data processing device 60. 

The illustrated data processing device 60 
includes a central processor (CPU) 62 and memory 64. The 
memory 64 is configured to store computer program 

25 instructions to be executed by the CPU 62 for performing 

the process steps represented by the block diagrams and 
flow charts of Fig. 2 and Figs. 4-5. The CPU 62 
communicates with the memory 64 via an address/data bus 
66. 

30 The CPU 62 may be, for example, a commercially 

available or custom microprocessor. The memory 64 is 
representative of the overall hierarchy of memory devices 
containing software and data used to facilitate and 
account for call-through advertising between third party 

35 advertisers and users of Web-enabled telephone devices in 
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accordance with embodiments of the present invention. The 
memory 64 may store other information and software such 
as applications programs, network communication programs 
{e.g., TCP/IP protocol), operating system software, 

5 server software, such as HTTP server software, etc. The 

memory 64 may include, but is not limited to, the 
following types of devices: cache, ROM, PROM, EPROM, 
EE PROM, flash, SRAM, and DRAM. 

Referring back to Fig. 2, the Web server 44 

10 hosts Web content in a text -based format, such as VXML. 

The Web server 44 is configured to retrieve (i.e., 
request) an advertisement from the advertisement server 
46 and insert the retrieved advertisement within user 
requested Web content . The Web server 44 is also 

15 configured to forward the user requested Web content and 

advertisement to the text-to-speech transcoder 42 for 
conversion to an audio format and subsequent delivery to 
a user client device 50 as an audio stream. 

The text-to-speech transcoder 42 is configured 

20 to convert Web content, and advertisements inserted 

therewithin, from a text-based format, such as VXML, to 
an audio format. The text-to-speech transcoder 42 is 
configured to serve the transcoded Web content (including 
advertisements) in an audio format to a user client 

25 device 50 (e.g., a telephone) via a telephone link with 

the user client device 50 . For advertisements that are 
configured to be interactive, the text -to- speech 
transcoder 42 may be configured to notify the 
advertisement server 46 of user interaction therewith. 

3 0 According to embodiments of the present 

invention, the text-to-speech transcoder 42 is configured 
to retrieve additional information associated with an 
advertisement in response to user interaction with the 
advertisement, and to deliver the additional information 

35 to the user client device 50 in an audio format. 

-10- 
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Additional information associated with an advertisement 
may be retrieved from the advertisement server 46 or from 
another source. According to embodiments of the present 
invention, the text-to-speech transcoder 42 is configured 
to recognize one or more key words spoken by a user 
during delivery of an advertisement to the user's client 
device 50. The text-to-speech transcoder 42 is configured 
to redirect the user client device to additional audio 
content associated with the advertisement in response to 
recognition of one or more key words spoken by the user. 

According to embodiments of the present 
invention, the advertisement server 46 is configured to 
select advertisements for insertion within user-requested 
Web content based upon the requested Web content, and/or 
based upon information associated with the requesting 
user. In addition, the advertisement server 46 may be 
configured to select advertisements for insertion within 
user-requested Web content having a format and size 
(e.g., a predetermined time length) compatible with user- 
requested Web content when the Web content is converted 
to an audio format. For example, user-requested Web 
content may be configured to include an advertisement 
having a length of thirty (3 0) seconds when converted to 
audio format. Accordingly, the advertisement server 46 
selects one or more advertisements that collectively do 
not exceed the thirty (30) second parameter. 

According to embodiments of the present 
invention, the advertisement server 46 may be configured 
to store information associated with user interaction 
with an advertisement. In addition, the advertisement 
server 46 may be configured to determine if a user 
listened to an advertisement in its entirety and/or 
determine how many times a user listens to an 
advertisement . 

Users receiving advertising and Web content in 



audio format in accordance with embodiments of the 
present invention may communicate with the Web server 44 
and text-to-speech transcoder 42 via any type of wireline 
and wireless telephone device. Exemplary telephone 
5 devices include, but are not limited to, personal 

computers with modems and/or radiotelephone capabilities, 
portable computers with modems and/or radiotelephone 
capabilities, handheld computers with modems and/or 
radiotelephone capabilities, personal digital assistants 

10 (PDAs) with modems and/or radiotelephone capabilities, 

pagers, cellular telephones, web phones, web-enabled 
radiotelephones, and other mobile/wireless devices. 

Referring now to Fig. 4, operations for 
integrating advertising within Web content requested by 

15 users according to embodiments of the present invention 

are illustrated. Upon receiving a request from a user for 
Web content via a telephone device, a Web server 44 
retrieves an advertisement from an advertisement server 
46 (Block 100) . The Web content and advertisement have a 

20 text-based format {e.g., VXML) and the advertisement may 

be configured to be interactive when converted to an 
audio format with the Web content . The Web server 44 
inserts the retrieved advertisement within the user 
requested Web content (i.e., within one or more VXML 

25 documents representative of the Web content) (Block 200) , 

and forwards the user requested Web content and 
advertisement in the VXML document (s) to a text-to-speech 
transcoder 42 for conversion to an audio format (Block 
300) . The text-to- speech transcoder 42 converts the Web 

3 0 content and advertisement from a text -based format to an 

audio format (Block 400) and serves the Web content and 
advertisement in the audio format (i.e., as an audio 
stream) to the user client device via a telephone link 
established with the user client device (Block 500) . 

35 If the advertisement is configured to be 
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interactive, the text-to-speech transcoder 42 notifies 
the advertisement server 46 of user interaction with the 
advertisement (Block 600). For example, the user's 
interaction with the advertisement (i.e., pressing a key 
5 on a keypad during the advertisement and/or speaking one 

or more recognizable words and/or phrases) is recorded by 
the advertisement server. Moreover, information such as, 
but not limited to, an identification of the requesting 
client device, user, and time and date information, etc., 

10 may be recorded by the advertisement server for use in 

measuring effectiveness of a particular advertising 
campaign. Information associated with providing a user 
with additional information associated with an 
advertisement may also be stored. 

15 According to embodiments of the present 

invention, the text-to-speech transcoder 42 may retrieve 
additional information associated with the advertisement 
in response to user interaction with an interactive 
advertisement (Block 700) and deliver the additional 

20 information to the user client device in an audio format 

(Block 800) . For example, a text-to-speech transcoder 42 
may be configured to recognize key words spoken by the 
user during delivery of an advertisement (Block 710, Fig. 
5) . In response to recognizing one or more key words 

25 spoken by the user, the text-to-speech transcoder 42 may 

be configured to redirect the user client device to 
additional Web content associated with the advertisement 
{e.g., to another Web site) (Block 720, Fig. 5). 
According to embodiments of the present invention, 

30 additional information may retrieved from (or via) the 

advertisement server 46 and delivered to the user client 
device . 

Still referring to Fig. 4, the advertisement 
server 4 6 may be configured to store information 
35 associated with serving an advertisement to a user (Block 
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900) . In addition, the advertisement server 46 may store 
information associated with user interaction with an 
advertisement. According to additional embodiments of the 
present invention, the advertisement server 46 may be 
5 configured to determine if and/or how many times a user 

listens to an advertisement (Block 1100) . 

The foregoing is illustrative of the present 
invention and is not to be construed as limiting thereof. 
Although a few exemplary embodiments of this invention 

10 have been described, those skilled in the art will 

readily appreciate that many modifications are possible 
in the exemplary embodiments without materially departing 
from the novel teachings and advantages of this 
invention. Accordingly, all such modifications are 

15 intended to be included within the scope of this 

invention as defined in the claims. Therefore, it is to 
be understood that the foregoing is illustrative of the 
present invention and is not to be construed as limited 
to the specific embodiments disclosed, and that 

20 modifications to the disclosed embodiments, as well as 

other embodiments, are intended to be included within the 
scope of the appended claims. The invention is defined by 
the following claims, with equivalents of the claims to 
be included therein. 

25 
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